Semi-Supervised Support Vector Machine using label mean (meanS3VM) for image classification selects a small number of unlabeled instances randomly to train the classifier, and the classification accuracy is low; meanwhile, the parameter's determination always derives much oscillation of the results. In allusion to the above problems, meanS3VM image classification method based on mean shift was proposed. The smoothed image acquired by mean shift was used as original segmented image to reduce diversities of image features; an instance in each smoothed area was randomly selected as unlabeled instance to ensure that it carried useful information for classification and had a more efficient classifier; and the parameters value were also investigated and improved, the grid search method was used for sensitive parameters, the parameter ep was estimated by combining with Support Vector Machine (SVM) mean shift results, so that there will be a better and more stable result. The experimental results indicate that the classification rate of the proposed method to ordinary and noise image can be averagely increased more than 1% and 5%, and it has higher efficiency and avoids the oscillation of the results effectively, which is suitable for image classification.